AI-PUCMDL: artificial intelligence assisted plant counting through unmanned aerial vehicles in India's mountainous regions.

This work introduces a novel approach to remotely count and monitor potato plants in high-altitude regions of India using an unmanned aerial vehicle (UAV) and an artificial intelligence (AI)-based deep learning (DL) network. The proposed methodology involves the use of a self-created AI model called PlantSegNet, which is based on VGG-16 and U-Net architectures, to analyze aerial RGB images captured by a UAV. To evaluate the proposed approach, a self-created dataset of aerial images from different planting blocks is used to train and test the PlantSegNet model. The experimental results demonstrate the effectiveness and validity of the proposed method in challenging environmental conditions. The proposed approach achieves pixel accuracy of 98.65%, a loss of 0.004, an Intersection over Union (IoU) of 0.95, and an F1-Score of 0.94. Comparing the proposed model with existing models, such as Mask-RCNN and U-NET, demonstrates that PlantSegNet outperforms both models in terms of performance parameters. The proposed methodology provides a reliable solution for remote crop counting in challenging terrain, which can be beneficial for farmers in the Himalayan regions of India. The methods and results presented in this paper offer a promising foundation for the development of advanced decision support systems for planning planting operations.

A genetic tradeoff for tolerance to moderate and severe heat stress in US hybrid maize.

Global climate change is increasing both average temperatures and the frequencies of extreme high temperatures. Past studies have documented a strong negative effect of exposures to temperatures >30°C on hybrid maize yields. However, these studies could not disentangle genetic adaptation via artificial selection from changes in agronomic practices. Because most of the earliest maize hybrids are no longer available, side-by-side comparisons with modern hybrids under current field conditions are generally impossible. Here, we report on the collection and curation of 81 years of public yield trial records covering 4,730 maize hybrids, which enabled us to model genetic variation for temperature responses among maize hybrids. We show that selection may have indirectly and inconsistently contributed to the genetic adaptation of maize to moderate heat stress over this time period while preserving genetic variance for continued adaptation. However, our results reveal the existence of a genetic tradeoff for tolerance to moderate and severe heat stress, leading to a decrease in tolerance to severe heat stress over the same time period. Both trends are particularly conspicuous since the mid-1970s. Such a tradeoff poses challenges to the continued adaptation of maize to warming climates due to a projected increase in the frequency of extreme heat events. Nevertheless, given recent advances in phenomics, enviromics, and physiological modeling, our results offer a degree of optimism for the capacity of plant breeders to adapt maize to warming climates, assuming appropriate levels of R&D investment.

Enhanced Field-Based Detection of Potato Blight in Complex Backgrounds Using Deep Learning.

Rapid and automated identification of blight disease in potato will help farmers to apply timely remedies to protect their produce. Manual detection of blight disease can be cumbersome and may require trained experts. To overcome these issues, we present an automated system using the Mask Region-based convolutional neural network (Mask R-CNN) architecture, with residual network as the backbone network for detecting blight disease patches on potato leaves in field conditions. The approach uses transfer learning, which can generate good results even with small datasets. The model was trained on a dataset of 1423 images of potato leaves obtained from fields in different geographical locations and at different times of the day. The images were manually annotated to create over 6200 labeled patches covering diseased and healthy portions of the leaf. The Mask R-CNN model was able to correctly differentiate between the diseased patch on the potato leaf and the similar-looking background soil patches, which can confound the outcome of binary classification. To improve the detection performance, the original RGB dataset was then converted to HSL, HSV, LAB, XYZ, and YCrCb color spaces. A separate model was created for each color space and tested on 417 field-based test images. This yielded 81.4% mean average precision on the LAB model and 56.9% mean average recall on the HSL model, slightly outperforming the original RGB color space model. Manual analysis of the detection performance indicates an overall precision of 98% on leaf images in a field environment containing complex backgrounds.

Identification and utilization of genetic determinants of trait measurement errors in image-based, high-throughput phenotyping.

The accuracy of trait measurements greatly affects the quality of genetic analyses. During automated phenotyping, trait measurement errors, i.e. differences between automatically extracted trait values and ground truth, are often treated as random effects that can be controlled by increasing population sizes and/or replication number. In contrast, there is some evidence that trait measurement errors may be partially under genetic control. Consistent with this hypothesis, we observed substantial nonrandom, genetic contributions to trait measurement errors for five maize (Zea mays) tassel traits collected using an image-based phenotyping platform. The phenotyping accuracy varied according to whether a tassel exhibited "open" versus. "closed" branching architecture, which is itself under genetic control. Trait-associated SNPs (TASs) identified via genome-wide association studies (GWASs) conducted on five tassel traits that had been phenotyped both manually (i.e. ground truth) and via feature extraction from images exhibit little overlap. Furthermore, identification of TASs from GWASs conducted on the differences between the two values indicated that a fraction of measurement error is under genetic control. Similar results were obtained in a sorghum (Sorghum bicolor) plant height dataset, demonstrating that trait measurement error is genetically determined in multiple species and traits. Trait measurement bias cannot be controlled by increasing population size and/or replication number.

Detection of the Progression of Anthesis in Field-Grown Maize Tassels: A Case Study.

The tassel of the maize plant is responsible for the production and dispersal of pollen for subsequent capture by the silk (stigma) and fertilization of the ovules. Both the amount and timing of pollen shed are physiological traits that impact the production of a hybrid seed. This study describes an automated end-to-end pipeline that combines deep learning and image processing approaches to extract tassel flowering patterns from time-lapse camera images of plants grown under field conditions. Inbred lines from the SAM and NAM diversity panels were grown at the Curtiss farm at Iowa State University, Ames, IA, during the summer of 2016. Using a set of around 500 pole-mounted cameras installed in the field, images of plants were captured every 10 minutes of daylight hours over a three-week period. Extracting data from imaging performed under field conditions is challenging due to variabilities in weather, illumination, and the morphological diversity of tassels. To address these issues, deep learning algorithms were used for tassel detection, classification, and segmentation. Image processing approaches were then used to crop the main spike of the tassel to track reproductive development. The results demonstrated that deep learning with well-labeled data is a powerful tool for detecting, classifying, and segmenting tassels. Our sequential workflow exhibited the following metrics: mAP for tassel detection was 0.91, F1 score obtained for tassel classification was 0.93, and accuracy of semantic segmentation in creating a binary image from the RGB tassel images was 0.95. This workflow was used to determine spatiotemporal variations in the thickness of the main spike-which serves as a proxy for anthesis progression.

TasselGAN: An Application of the Generative Adversarial Model for Creating Field-Based Maize Tassel Data.

Machine learning-based plant phenotyping systems have enabled high-throughput, non-destructive measurements of plant traits. Tasks such as object detection, segmentation, and localization of plant traits in images taken in field conditions need the machine learning models to be developed on training datasets that contain plant traits amidst varying backgrounds and environmental conditions. However, the datasets available for phenotyping are typically limited in variety and mostly consist of lab-based images in controlled conditions. Here, we present a new method called TasselGAN, using a variant of a deep convolutional generative adversarial network, to synthetically generate images of maize tassels against sky backgrounds. Both foreground tassel images and background sky images are generated separately and merged together to form artificial field-based maize tassel data to aid the training of machine learning models, where there is a paucity of field-based data. The effectiveness of the proposed method is demonstrated using quantitative and perceptual qualitative experiments.

Semiautomated Feature Extraction from RGB Images for Sorghum Panicle Architecture GWAS.

Because structural variation in the inflorescence architecture of cereal crops can influence yield, it is of interest to identify the genes responsible for this variation. However, the manual collection of inflorescence phenotypes can be time consuming for the large populations needed to conduct genome-wide association studies (GWAS) and is difficult for multidimensional traits such as volume. A semiautomated phenotyping pipeline, TIM (Toolkit for Inflorescence Measurement), was developed and used to extract unidimensional and multidimensional features from images of 1,064 sorghum (Sorghum bicolor) panicles from 272 genotypes comprising a subset of the Sorghum Association Panel. GWAS detected 35 unique single-nucleotide polymorphisms associated with variation in inflorescence architecture. The accuracy of the TIM pipeline is supported by the fact that several of these trait-associated single-nucleotide polymorphisms (TASs) are located within chromosomal regions associated with similar traits in previously published quantitative trait locus and GWAS analyses of sorghum. Additionally, sorghum homologs of maize (Zea mays) and rice (Oryza sativa) genes known to affect inflorescence architecture are enriched in the vicinities of TASs. Finally, our TASs are enriched within genomic regions that exhibit high levels of divergence between converted tropical lines and cultivars, consistent with the hypothesis that these chromosomal intervals were targets of selection during modern breeding.

The effect of artificial selection on phenotypic plasticity in maize.

Remarkable productivity has been achieved in crop species through artificial selection and adaptation to modern agronomic practices. Whether intensive selection has changed the ability of improved cultivars to maintain high productivity across variable environments is unknown. Understanding the genetic control of phenotypic plasticity and genotype by environment (G × E) interaction will enhance crop performance predictions across diverse environments. Here we use data generated from the Genomes to Fields (G2F) Maize G × E project to assess the effect of selection on G × E variation and characterize polymorphisms associated with plasticity. Genomic regions putatively selected during modern temperate maize breeding explain less variability for yield G × E than unselected regions, indicating that improvement by breeding may have reduced G × E of modern temperate cultivars. Trends in genomic position of variants associated with stability reveal fewer genic associations and enrichment of variants 0-5000 base pairs upstream of genes, hypothetically due to control of plasticity by short-range regulatory elements.

Distinct genetic architectures for phenotype means and plasticities in Zea mays.

Phenotypic plasticity describes the phenotypic variation of a trait when a genotype is exposed to different environments. Understanding the genetic control of phenotypic plasticity in crops such as maize is of paramount importance for maintaining and increasing yields in a world experiencing climate change. Here, we report the results of genome-wide association analyses of multiple phenotypes and two measures of phenotypic plasticity in a maize nested association mapping (US-NAM) population grown in multiple environments and genotyped with ~2.5 million single-nucleotide polymorphisms. We show that across all traits the candidate genes for mean phenotype values and plasticity measures form structurally and functionally distinct groups. Such independent genetic control suggests that breeders will be able to select semi-independently for mean phenotype values and plasticity, thereby generating varieties with both high mean phenotype values and levels of plasticity that are appropriate for the target performance environments.

Mapping Chemical Selection Pathways for Designing Multicomponent Alloys: an informatics framework for materials design.

A data driven methodology is developed for tracking the collective influence of the multiple attributes of alloying elements on both thermodynamic and mechanical properties of metal alloys. Cobalt-based superalloys are used as a template to demonstrate the approach. By mapping the high dimensional nature of the systematics of elemental data embedded in the periodic table into the form of a network graph, one can guide targeted first principles calculations that identify the influence of specific elements on phase stability, crystal structure and elastic properties. This provides a fundamentally new means to rapidly identify new stable alloy chemistries with enhanced high temperature properties. The resulting visualization scheme exhibits the grouping and proximity of elements based on their impact on the properties of intermetallic alloys. Unlike the periodic table however, the distance between neighboring elements uncovers relationships in a complex high dimensional information space that would not have been easily seen otherwise. The predictions of the methodology are found to be consistent with reported experimental and theoretical studies. The informatics based methodology presented in this study can be generalized to a framework for data analysis and knowledge discovery that can be applied to many material systems and recreated for different design objectives.

Extracting features buried within high density atom probe point cloud data through simplicial homology.

Feature extraction from Atom Probe Tomography (APT) data is usually performed by repeatedly delineating iso-concentration surfaces of a chemical component of the sample material at different values of concentration threshold, until the user visually determines a satisfactory result in line with prior knowledge. However, this approach allows for important features, buried within the sample, to be visually obscured by the high density and volume (~10(7) atoms) of APT data. This work provides a data driven methodology to objectively determine the appropriate concentration threshold for classifying different phases, such as precipitates, by mapping the topology of the APT data set using a concept from algebraic topology termed persistent simplicial homology. A case study of Sc precipitates in an Al-Mg-Sc alloy is presented demonstrating the power of this technique to capture features, such as precise demarcation of Sc clusters and Al segregation at the cluster boundaries, not easily available by routine visual adjustment.

Automated voxelization of 3D atom probe data through kernel density estimation.

Identifying nanoscale chemical features from atom probe tomography (APT) data routinely involves adjustment of voxel size as an input parameter, through visual supervision, making the final outcome user dependent, reliant on heuristic knowledge and potentially prone to error. This work utilizes Kernel density estimators to select an optimal voxel size in an unsupervised manner to perform feature selection, in particular targeting resolution of interfacial features and chemistries. The capability of this approach is demonstrated through analysis of the γ / γ' interface in a Ni-Al-Cr superalloy.

"Property Phase Diagrams" for Compound Semiconductors through Data Mining.

This paper highlights the capability of materials informatics to recreate "property phase diagrams" from an elemental level using electronic and crystal structure properties. A judicious selection of existing data mining techniques, such as Principal Component Analysis, Partial Least Squares Regression, and Correlated Function Expansion, are linked synergistically to predict bandgap and lattice parameters for different stoichiometries of GaxIn1-xAsySb1-y, starting from fundamental elemental descriptors. In particular, five such elemental descriptors, extracted from within a database of highly correlated descriptors, are shown to collectively capture the widely studied "bowing" of energy bandgaps seen in compound semiconductors. This is the first such demonstration, to our knowledge, of establishing relationship between discrete elemental descriptors and bandgap bowing, whose underpinning lies in the fundamentals of solid solution thermodyanamics.